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In the most general two-Higgs doublet model (generally referred to as 
Model III), tree level scalar-mediated flavor changing neutral couplings ex- 
ist. It has been noted that the most natural value for such a coupling 
is of the order of the geometric mean of the Yukawa couplings of the two 
fermions. Bounds on those couplings that involve the second and third gen- 
erations, from t,B,D and \x physics, are very weak and are not sensitive 
to this "natural" value. In this paper, it is pointed out that the process 
— > fir, at a muon collider tuned to the scalar resonance, will eas- 
ily reach this sensitivity if the scalar mass is below 140 GeV. Hundreds of 
events are expected for an integrated luminosity of an inverse femtobarn, 
and there appears to be no background. Failure to observe this process, if 
the scalar is below 140 GeV, would effectively rule out Model III. 
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The most important unanswered question in the Standard Model(SM) 
is the nature of electroweak symmetry breaking. Should the Higgs bosons 
and/or additional scalars be discovered in the next few years at either the 
Tevatron or the LHC, it will be crucial to explore the properties of these 
particles in detail. A primary motivation for the muon collider [0J is that a 
large number of scalars can be produced through s-channel resonance, and 
thus a muon collider could be a "Higgs" factory. 

The capabilities of a muon collider for exploring Higgs physics in the 
Standard Model and in the Minimal Supersymmetric Standard Model(MSSM) 
have been explored extensively]!]]. The simplest extension of the Standard 
Model is the two-Higgs doublet model(2HDM). In this model, tree level fla- 
vor changing neutral currents (FCNC) will naturally occur. This is because 
there are two Yukawa coupling matrices, and thus diagonalization of the 
quark mass matrix will not automatically diagonalize each of the Yukawa 
matrices. These FCNC are phenomenologically dangerous, leading, for ex- 
ample, to large contributions to K° — K° mixing. 

It is important to note that one can always choose a basis in which one 
scalar field acquires a vacuum expectation value and the other does not. 
In this case, the latter does not participate at all in electroweak symmetry 
breaking and is the only scalar with FCNC couplings, and there is no a 
priori reason that its mass should be light. If its mass is greater than a 
few TeV[||, there is no FCNC problem. This is the most straightforward 
solution, and the effective theory below a TeV is then just the standard 
model. 

However, when people refer to the 2HDM, they generally refer to the 
situation in which this extra scalar is light, with a mass on the order of 
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the electroweak scale .Q In this case, something must suppress the flavor- 
changing couplings. 

One method of suppression P], which eliminates tree- level FCNC com- 
pletely, is to assume that a discrete symmetry either couples all of the 
fermions to only one of the scalar doublets (Model I) or else couples one 
doublet to the Q=2/3 quarks and the other to the Q=-l/3 quarks (Model 
II). Such a discrete symmetry is completely ad hoc. Note that Model II 
type couplings automatically occur in the MSSM, but if an additional pair 
of Higgs doublets is added to the MSSM, the same problem recurs. 

Another method of suppression is to assume that the flavor-changing 
neutral couplings are small. It was pointed out in Ref. @] that in a variety 
of mass matrix models, the FCNC couplings are approximately given by 
the geometric mean of the Yukawa couplings of the two fermions (this 
is now referred to as Model III). With this ansatz, the FCNC couplings 
involving the first generation fields are very small, and the bounds are not 
as severe. The largest flavor-changing couplings will then involve those 
between the second and third generations. The FCNC couplings can only 
be bounded phenomenologically, and there are several detailed analyses of 
these bounds ||, [J, coming from K, D, B and r physics. 

What will a muon collider be able to tell us about Model III? Atwood, 
Reina and Soni|7J showed that the process — > H —> tc + tc could 

occur at an easily observable rate, since the geometric mean of the top 
and charm Yukawa couplings is greater than the bottom quark Yukawa 

coupling. Depending on parameters, one could detect large numbers of 

^his would involve fine-tuning, of course, but no more fine-tuning than in the MSSM, where the 
SUSY breaking scale and the electroweak scale are logically independent. 
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events, with an integrated luminosity of an inverse femtobarn, if the scalar 
mass exceed 180 GeV. 

In this Letter, another signature of Model III, which is both cleaner than 
the hadronic signature and which does not require the scalar to be heavier 
than the top quark, is discussed. This signature is fi + fi~ — > H — > /it. For 
a 120 GeV scalar, for example, one would see a 60 GeV muon back-to-back 
with a 60 GeV tau. Since any other process that produces a high-energy 
muon will result in a muon with less than half the center-of-mass energy, 
there will be no background. We will see that there will be large number 
of events, and failure to detect this signal would virtually rule out Model 
III. 

Let us first consider the Yukawa interaction of two scalar doublets to 
fermions 

C = rfiQifaUj + vSQAD, + rfiLfaEj + ^QfoUj + SgQfaDj + ^L^E, (1) 

In this Letter, we will consider the neutral fields only, and will ignore 
possible CP violation, focusing on the CP-even scalars. 

Without loss of generality, one chooses a basis such that only one scalar, 
0i, acquires a VEV, v = 246 GeV, and the other, <f> 2 , does not (thus, 2 does 
not participate in symmetry breaking and does not really deserve the label 
"Higgs boson" ) . The Yukawa interactions of 0i are proportional to the mass 
matrix and are therefore flavor-diagonal, whereas the Yukawa interactions 
of 02 are arbitrary and give FCNC. In order to prevent tree level FCNC, 
one must impose a discrete symmetry in Eq. 1, such as 02 <-> —02- In 
Model III, no such symmetry is imposed. 

For experimental purposes, one should use the physical mass basis for 
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the Higgs bosons, h and H. We define the h field to be the lighter of the 
two. In the conventional notation, this basis is rotated by an angle a from 
the basis of Eq. 1. Ignoring the imaginary part of the Yukawa couplings, 
the couplings of the h field to f i fj is 

n 9 m i , ■ , &j 

Chf f = tt~ou sin a H 1= cos a 

It was suggested by Cheng and Slier [||] that the most natural value for 
the which occurs in many mass- matrix models, is given by the geometric 
mean of the Yukawa couplings of the two fermions, i.e. writing 

one expects to have \j ~ 1. 

There have been a number of papers[4-15] examining Model III and 
constraining the allowed values of Ay (where i ^ j). The most extensive 
analyses are those of Refs. |J,f|. In the former, limits from rare r and 
rare B decays were considered, and in the latter, effects from F° — F° 
(where F = K, D, B, B s ), e + e~(/i + / u _ ) — > tc + ct, Z — > bb, t — > 07 and 
the p parameter were considered. The result of these analyses show that 
A£ << 1, Xdb < 1 anc i ^uc < 1- In other words, the FC couplings involving 
the first generation seem to be very small. 

There are several 2HDM models |T7|, [H| in which the involving the 
first generation are much smaller than one, and one might argue that the 
extremely small Yukawa couplings of the first generation might be subject 
to perturbations from physics at a very high scale. A true test of Model III 
would be to examine FC couplings involving the second and third genera- 
tions (if those are small, then Model III would be excluded). This might 



be particularly interesting in view of the fact that the atmospheric neu- 



trino problem indicates |y| very large mixing between the second and third 
generations in the neutrino sector. However, looking at rare r and rare 
B decays|| can not reach the A Mr ~ 1 or A& s ~ 1 sensitivity without an 
improvement of many orders of magnitude over current limits, and B s — B s 
mixing is already maximal. One can consider t — > cy, but the branching 
fractions are very small. The decay t — > ch is promising although the 
branching fraction is less than a percent (for X ct = 1). Recently, a very ex- 
tensive analysis of detection of t —>■ ch at the LHC has been carried out[IB|. 
There it was shown that one would be able to detect the decay for Act = 1 
fairly easily, and that failure to detect the signal would give A ct < 0.12. 
There has also been a detailed analysis |2(|] of top-charm production at the 
NLC; although the signature is fairly clear due to the distinct kinematics, 
the rate remains small. 

At a muon collider, one will be produce scalar bosons as an s-channel 
resonance, and tens of thousands of scalars will be produced directly. At- 
wood, Reina and Soni|7]] showed how the process h — > tc + tc would have a 
very distinctive signature and a high event rate. However, it does require 
the scalar to have a mass above 180 GeV. 

Since large mixing has only been observed in the neutral lepton sector 
between the second and third generations, one naturally would want to 
look at the charged lepton sector, i.e. at A^ r . The muon collider provides 
a "smoking gun" signature for this coupling — the decay h — > //r. This will 
have a high event rate, and zero background.^ 



2 This decay was considered in the context of the Tevatron (where the scalar is produced off-resonance) 
in Ref. ]l5|| . They showed that if the current bound on A MT is saturated, a signal of h — > fir could be 
seen at the Tevatron. 
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The cross section for production of a state X at the muon collider, 
convoluted with the collider energy distribution, is given by(l|] 

4tt B(h -> fi+fi-)B(h^X) 



Oh 



h n + !(¥)] I/2 

where the B are the branching ratios, is the total width and the Gaussian 
spread in the beam energy y/s is given by = -j^^/s, with R the energy 
resolution of each beam. The energy resolution is expected to be in the 
range 0.005% — 0.05%. We will look at relatively light scalars; for m h < 140 
GeV, the Higgs boson is narrow and the cross section is proportional to 

r h /R. 

The result depends on the couplings of the scalar to /i pairs as well as 
(j, — r. For the former, we will not include a possible £ w contribution- 
this is unknown and is expected to be of the same order as the standard 
model contribution. Note that any enhancement in this coupling will be 
determined as soon as the resonance is found at the muon collider. For the 
H — t coupling, we will assume that A MT cos a = 1 (the cross section will, 
of course, scale as A 2 T cos 2 a). Since the total width of the scalar boson is 
(for masses below about 140 GeV) dominated by 6-quark decays, we have 

3g 2 m 2 b m H 



32nm 2 



w 
1 m 2 . 



3 m?' 



and 



For an integrated luminosity of 1 femtobarn, and a resolution of R = 
0.005% (both of which are achievable), the total number of events is given 
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by (930,740,540,330,100,1) for m h = (100,110,120,130,140,150) GeV. 
Note that for larger masses, the rate drops considerably since new decay 
channels open up and the branching ratios drop substantially. The event 
rate also scales as 1/R, should the given resolution not be achievable. 

We see that for masses below 140 GeV, we expect hundreds of events 
in an inverse femtobarn. The signal would be dramatic. One would see 
a muon and a tau each with an energy of half the center-of-mass energy. 
The impact parameter for tau decays at this energy is approximately 100 
micronsPTJ, which should be resolvable. But even if the tau vertex can not 



be seen, the mere presence of a muon with half the beam energy (and no 
muon of similar energy on the other side) would indicate new physics, and 
the decays of the tau will provide a smoking gun for this model. There 
appears to be no substantial background; any other particles produced 
which decay into muons will have the muon energy degraded. 

Suppose the scalar has a mass of 120 GeV. Then failure to see any signal 
would put an upper bound on A MT cos a of substantially less than 0.1 (and 
cos a would likely be determined when the scalar is initially discovered). 
Since this is expected to be the largest coupling, such a bound (coupled 
with failure to observe t — > ch at the LHC[[nj) would effectively rule out 
Model III. 

What about other flavor- changing processes? One can look for [i + — > 
er just as easily. However, here the number of events expected (for A eT cos a - 
1) is down by a factor of m^/rrig ~ 200. Thus, one would expect only a few 
events. Nonetheless, the background is negligible, and this would provide 
the best bound on X er (and would provide a good check if the \ir signature 
is seen). One can also look for yU + /i~ — > bs + bs, which would constitute 
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roughly 3% of all decays, but the background from bb would probably rule 
out substantive limits. 

If the scalar mass is below 140 GeV, then Model III predicts hundreds 
of fir events will be observed at the first muon collider. Although one can 
never experimentally rule out tree level flavor changing neutral couplings at 
some level, the primary motivation for Model III requires that the largest 
flavor changing couplings give A ~ 1. The muon collider will thus provide 
a definitive test of this Model. 

I thank Vernon Barger and Lorenzo Diaz-Cruz for useful discussions, 
and Chris Carone for reading the manuscript. This work was supported 
the National Science Foundation grant NSF-PHY-9900657. 
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